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[57] ABSTRACT 

A design for a network route server in which network 
routing functions are distributed throughout the processing 
elements that constitute a switching node, while maintaining 
the global identity and routing information exchange func- 
tions of a route server element (RSE). Intelligent hne -cards 
are provided having the ability to route independently of the 
RSE. This removes the RSE as a bottleneck resource and 
ensures that the capacity of the switching node is limited 
only by the switching capacity of its switch fabric. The RSE 
serves the functions of network topology discovery and 
routing table construction using a network topology data- 
base and an optimal routing algorithm. Copies of the 
dynamically maintained routing tables are distributed to the 
intelligent line -cards on a periodic basis governed by pre- 
determined criteria. Wider geographical distribution of the 
RSE is enabled and most efficient utilization of the switch 
fabric is ensured. Scaling of distributed switching architec- 
tures is also enabled, llie advantage is a significant increase 
in switching capacity as well as an increased degree of 
network connectivity. 

19 Claims, 4 Drawing Sheets 
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DISTRIBUTED ROUTE SERVER payload traffic. The exponential growth of packetized data 

traflSc is now placing onerous switching burdens on network 

TECHNICAL FIELD ^^^^^ j^^^^ therefore exists a need for a network route 

The present invention relates to telecommunications server having scalable routing and forwarding functions in a 

packet or cell switches and, in particular to a scalable ^ distributed switching architecture in order to supply the 

architecture for a network route server which is capable of packet switching capacity now required, 

efficiently switching both connectionless and connection- SUMMARY OF THE INVENTION 

oriented payload traffic. y-ir r t • j 

It IS therefore an object of the mvention to provide a 

BACKGROUND OF THE INVENTION scalable switching architecture for a network route server in 

In the currently-evolving network environments, there is ""^'"^ '""''"S '"^'^P'^' embedded in the 

an increasing requirement for flexible connectivity between switch architecture. 

switching nodes for the carriage of payload, control and ^ ^^^her object of the invention to provide a scalable 
management traffic. Although switching nodes were once is architecture for a network route server in which routing 
monolithic entities, they are more and more becoming functions are distributed to intelligent line-cards which 
complex distributed architectures which facilitate diversity autonomously handle the routing of all packet traffic, 
in services and scalability in capacity. The rapid growth of is a further object of the invention to provide a scalable 
packetized data traffic in LEC and lEC networks requires architecture for a network route server in which the central 
that switching nodes perform muli-layer switching functions controller is dedicated to network topology discovery and 
and handle both connectionless and connection-oriented dynamic routing table maintenance based on network pay- 
network traffic. Therefore, there exists a need for scalable l^^d traffic to ensure improved connectivity and switching 
routing and forwarding functions in a distributed switching efficiency in the network. 

architecture. 25 invention therefore provides a network route server 

Both existing and evolving routing protocols such as "^^^ ^ scalable switching architecture comprising a route 

Asynchronous Transfer Mode (ATM), Forum Private server element with which a node identity in the network is 

Network-Network-Interface Specification (PNNI), Internet associated, the route server element including processor 

Open Shortest Path First (OSPF), and International Stan- 1^^^"^ for executing a topology discovery protocol and 

dards Organization (ISO) Open Systems Interface (OSI) maintaining a topology database of the network, and for 

identify a network node by the identify of its Route Server creating a routing table for the route server using the 

Element (RSE) which is some form of global address. Each topology database and a routing algorithm, the route server 

RSE generates a routing table based on a preferred perfor- element periodicaUy copying the routing table to an array of 

mance metric and a most recent topological view of the 35 P^^ket processing elements associated with the route server 

network. The table thus creates optimal routes for commu- element; 

nication throughout the network. The RSE is responsible for each packet processing element having a link-port inter- 
administration of the algorithms that enable a node to keep face to the network, memory means for storing the copy of 
its view of the network topology and performance metric the routing table, and processor means for using the routing 
current, referred to as Routing Information Exchange (RIE). table to route packets received by the processing element 
This combination of responsibilities often necessitates the whereby each packet processing element Is enabled to 
need for the RSE to act as a central focus for the routing of autonomously route any packet received by the packet 
traffic through the switching node. The consequence of this processing element by reference to the copy of the routing 
is that the RSE becomes a bottleneck resource Umiting the 45 *able; and 

capacity and scalability of a distributed switch architecture. a switch fabric for switching of packets between the 
The impact of this bottleneck has been recognized and packet processing elements in accordance with the routing 
efforts to minimize its impact have resulted in the invention information provided by the packet processing elements, 
of intelligent input/output controllers which autonomously The invention therefore provides a scalable switching 
handle a portion of the packet routing function. Such con- architecture which removes routing as a functionality that is 
trollers are described for example in U.S. Pat. No. 4,494,230 closely embedded within the switch architecture. It therefore 
which issued on Jan. 15, 1985 to Turner, and U.S. Pat. No. becomes possible to integrate switching and routing across 
5,367,518 which issued on Nov. 22, 1994 to Newman. These the network over a wider geographical area. The resulting 
patents respectively describe packet switching systems dedi- 55 architecture is capable of significantly increasing the switch- 
cated to connection-oriented traffic in which intelligent ing capacity as well as increasing the degree of network 
controllers request packet routing information from a central connectivity. The network connectivity is increased because 
control unit only on call connection setups. The routing the RSE is dedicated to performing information routing 
information supphed by the central controller is stored in a exchange functions and relieved of the load-dependent func- 
routing look-up table in controller resident memory. lion of traffic forwarding which is handled by the packet 
Thereafter, the controller uses the same routing information processing elements, hereinafter referred to as "intelligent 
to route all packets associated with the call connection, thus line-cards". Consequently, the scalable architecture in accor- 
freeing the central controller to attend to other functions. dance with the invention permits improved scaling as net- 
While this switching model improves the switch throughput ^5 work size increases. 

of connection-oriented packet switching systems, it does not The performance requirements of the distributed route 

alleviate the central controller bottleneck for connectionless server architecture are preferably enabled with a two-level 
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priority control mechanism. The control connectivity 
mechanism should also be over-provisioned with sufiBcient 
capacity to permit multi-cast and reliable end-to-end trans- 
mission capability. Overall the performance of the distrib- 
uted architecture provides reduced transit delays and a 
capacity that scales to the capacity of the switch fabric. 

The network route server in accordance with the invention 
consists of a central control which is responsible for attend- 
ing to all admission control for connection-oriented services 
and Virtual Circuit Identifier (VCI) tables for connection- 
oriented trafiBc. It is also responsible for network topology 
discovery and executes a network topology discovery pro- 
tocol in which network topology packets are exchanged with 
other network nodes in order to maintain a dynamic liiik- 
state topology database that reflects the current network 
connectivity. Using the topology database and a preferred 
routing algorithm, the central control builds and rebuilds 
routing tables used for routing packets to an adjacent node. 
The VCI tables and the routing tables are downloaded to the 
intelligent line-cards on a periodic basis dictated principally 
by the amount of time required by the central control to 
perform routing table calculations. Thereafter the updated 
routing tables are distributed to the intelligent line-cards as 
soon as possible without putting undue stress on nodal 
resources. Routing table updates may likewise be dictated 
by a change in network topology or significant traflBc fluc- 
tuations reported via link-state packets. 

VCI tables in the line -cards are updated on the setup of 
new connections or the tear-down of existing connections. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing a generic view of 
routing information exchange in a modern network; 

FIG. 2 is a block diagram showing a preferred switching 
architecture for a net route server in accordance with the 
invention; 

FIG, 3 is a graph showing transaction delay as a function 
of capacity in the updating of routing tables and virtual 
circuit connections; 

FIGS. 4a and 4b respectively schematically iUustrate the 
transit delay encountered by a packet traversing an uncon- 
gested route server having a distributed routing architecture 
in accordance with the invention and a prior art route server 
having a cenlraUy-controUed routing architecture; and 

FIG. 5 is a graph showing the transit delays as a function 
of offered traffic in a route server having a distributed 
routing architecture in accordance with the invention and a 
route server having a centrally controlled routing architec- 
ture in accordance with the prior art. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

l^e scalable switching architecture for a network route 
server in accordance with the invention distributes the 
network routing function throughout the processing ele- 
ments that constitute a switching node, while maintaining 
the global identity and the RIE function at the RSE. The 
abiUty of each intelligent line -card to route independently 
removes the RSE as a bottleneck resource and the capacity 
of the switching node is then limited only by the switching 
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capacity of the switch fabric. A variety of technologies are 
now available to make the capacity of the switch fabric 
engineerable to match the size and roll of the switching 
node. Routing is thereby converted from a function which is 

5 firequently deeply embedded in the switch architecture to a 
configurable platform independent distributed application. 
By extracting routing from being embedded within the 
switch architecture it becomes possible to integrate switch- 
ing and routing across the network over a wider geographi- 
cal area. This is an important factor in a drive towards 
routing technology convergence as the clash of voice and 
data networks enters a new phase. 

In order to explain a generic model of basic routing 

35 functions in a network server, three widely used routing and 
connection management protocols are briefly discussed 
below. Those routing and connection management protocols 
include OSI Intermediate Systems to Intermediate Systems 
(IS-IS), Internet OSPF and ATM forum PNNI, The first two 

20 protocols deal with connectionless routing of packet data 
while the latter includes capabilities for handling of 
connection-oriented multi-media services. The generic 
model captures the essence of the routing and forwarding 
functions and is used to develop the metrics for dimension - 
ing the model to assess the performance of the distributed 
route server and its forwarding engine in accordance with 
the invention. 

OSI Intra-Domain Routing Information Exchange 

3Q In accordance with the ISO/IEC 10589 protocol, routing 
domains are composed of areas within which detailed rout- 
ing information is maintained within individual network 
elements that comprise an area. These network elements are 
referred to as Intermediate Systems (LS). They are capable of 

35 dynamic auto-configuration of the area topology as well as 
the forwarding of protocol data units (PDU) received from 
adjacent nodes known as neighbours. Each node develops a 
routing table which allows PDUs to be forwarded based on 
some optimal policy such as a Shortest Path First (SPF) 
algorithm. While neighbours use a Hello-protocol to main- 
tain adjacency, a "flooding" scheme is used to exchange 
authenticated link states throughout an area. In a flooding 
scheme, when an IS receives a PDU it automaticaUy copies 

45 the PDU to all adjacent nodes with which it has a neigh- 
bouring relationship and the PDU thereby propagates 
throughout the network. Link states carry addressing and 
quality of service (QOS) information. In accordance with 
ISO 8473 which relates to a protocol for providing the 
connectionless mode network service, four metrics are car- 
ried: default, delay, expense, and error metrics. Protocol is 
also flexible enough to permit the creation of sub-nets 
advertised through designated intermediate systems. The 

55 forwarding function provides a connectionless network 
layer capability where a PDU is carried closer to its desti- 
nation as it traverses the network domain. Routing between 
areas is accomplished through a second level of hierarchy 
where each area is represented by level-2 intermediate 
system. Level-2 intermediate systems use area addresses to 
route a packet according to some optimal policy such as SPF 
to the nearest level-2 IS which in turn forwards the packet 
within the destination routing area. 

65 Internet Open Shortest Path First (OSPF) 

In the Internet Protocol (IP), networks consist of autono- 
mous systems (AS) each consisting of routing areas. Within 
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an area area sub- nets are formed for the purpose of estab- set up source -destination routes for connection -oriented 

lishing adjacencies and flooding of link slate information. trafiSc. The routing table is also used for routing of connec- 

The OSPF link state protocol is capable of dynamic auto- tions controlled and tracked by virtual circuit identifiers 

configuration of the AS topology as well as forwarding of stored in VCI tables 28 and virtual path identifiers used to 
packets received from adjacent nodes. Link states are propa- 5 identify bundles of virtual connections which are stored in 

gated depending on the location and designation of the yPI tables 30. VCI and VP! tables are both well known in 

routers which are responsible for routing table maintenance ^rt. A forwarding engine 32 uses such routing informa- 

and fonvardmg of packets. Four types of routers are defined. ^-^^ ^^^^^ ^^^^^ connectionless trafiSc closer to an 

They include: mtemal, border, backbone and boundary end destination, or to switch virtual connections, 

router^. Asmgle router may have more than one designation. perfonnance Dimensions of the Generic Model 

Complete Imk state information is advertised within an area ^ j ^^^^^^^ ^^^^^ ^^^^^ 

by mtemal routers while summary route infoncnation is . u • j ..u j • r .u u • 

, . , , . , , , , i . , , . , remain synchronized with dynamics or the changing net- 
advertised on the backbone and by the border and boundary i . i n la j .re 
™ . . , V u onr work topology as well as the flow and concentration of 
routers. This permits an optimal routing pohcy such as SPF . t , . c 
, , ,^ . . . 1- u traflBc throughout the network. The update frequency there- 
to be used for routing within an autonomous system. Each ^ . ^ . , . ^ . 
router node therefore maintains a topology database, a fore is of the same order as that of caU connection setups, or 
routing table and a forwarding capability. A Type of Service ^^^S^^ ^ ^^"^ reconfigurations. Tlie forwarding 
(TOS) field in the IP packets may be used to create routes however, has to be capable of handling packet/ 
based on QOS requirements such as delay, throughput and 20 ^^^^ Th^^^fore for connectionless traffic 
reliability. All OSPF protocol exchanges are authenticated. ^^e time required to access the routing tables becomes a 
ATM Forum Private Network-Network Interface Specifica- ^"^^^^^ ^^^^^^ ^^^^^"g capability of the forwarding 
tion (PNNI) engine 32. Consequently, distributed implementation of the 
ATM Forum PNNI protocols include both routing and forwarding function will scale the time required to access 
signalling functions in an integral scheme for providing a ^5 the routing tables. Distribution of the routing tables is 
rich mix of services including the carriage of both therefore desirable. Such distribution may be logical, i.e. a 
connection-oriented and connectionless traffic. In order to shared memory architecture, or physical using a loosely- 
accommodate large networks, PNNI creates multiple levels coupled architecture shown in the preferred embodiment 
of hierarchy in a given network. The lowest level, referred 30 schematically illustrated in FIG. 2, which will be explained 
to as a peer group, is maintained by the use of Hello- detail below. The performance metrics of such a scalable 
protocols and flooding of link stales. Logical peer groups are switching architecture can be described in terms of three 
then formed to permit communications between peer parameters: 

groups. This organization is accomplished by selecting peer 1, Packet transit delay: defined as the interval between 

group and logical peer group leaders which form overlay arrival of the last bit of an incoming packet (or its 

networks for the distribution of summary routing inform a- header) on an input port of a route server and that of 

tion at different levels. PNNI uses the services of its signal- transmitting the first bit of the same packet on the 

ling part to establish routes between source and destination destination output port of the route server, 
pairs. Such routes can be selected based on QOS criteria as ^„ 2. Packet loss: occurs due to capacity limitations of the 

defined by User Network -Interface (UNI) traffic manage- forwarding engine 32 or switch fabric. Note that further 

. -m. • 1 J u • c packet loss may occur at output buffers of the switch, 

ment specifications. These include a comprehensive set 01 u - l • • j j . ir .t. i.- . r .i_ 

^ , • , which IS independent or the architecture of the route 

parameters such as available bit rate, maximum supported server 

bit rate, likely variability in end-to-end delay known as ^ ti 1 * l * j j *l * * u- u 1 * 

„ , . . . 3. Packet throughput: denned as the rate at which packets 

jitter^ for cells, and cell loss ratio with cell loss priority. 45 processed reliably. It is desirable that switch 
PNNI makes no assumption about an optimal routing capacity be limited by that of the switch fabric rather 
algorithm, such as SPF. Optimal routing is left to Imple- than that of the routing function or that of the forward- 
mentation. The protocol is capable of responding to changes ing engine 32. 

in traffic patterns in the form of dynamic routing of traffic. Scalable Switching Architecture for a Network Route Server 

This, coupled with reachability information also inherent in The scalable switching architecture for a network route 

the routing database, provides a basis for making efficient server in accordance with the invention is schematically 

routingdecisionsforthecarriageof connection-oriented and illustrated in FIG. 2. The network route server, generally 

connectionless traffic. indicated by reference 40, includes a switch fabric 42 and 
Generic Model for the Route Server 55 control connectivity 44, The switch fabric 42 and the control 

The basic building blocks which provide generic func- connectivity 44 are shown as separate entities in FIG. 2 to 

tionality for the three protocols briefly described above are differentiate the basic design functions. The control connec- 

shown in FIG. 1. A topology discovery protocol 20 distrib- tivity 44 is preferably a backplane bus, well known in the art. 

ules fink slate information which is used to build a topology It is possible, nonetheless, to overlap the control connectiv- 

database 22. The topology database 22 includes addressing ity 44 and the switch fabric 42. If this is done, however, the 

and reachability information as well as QOS descriptions for switch fabric then must handle the control traffic which is 

various links in the network. The topology database in described below, in addition to payload traffic. Such overlap 

conjunction with an optimal routing algorithm is used to is therefore only desirable in geographically dispersed 
generate routing tables 24 for directing flows of packet 55 switching systems where a multi-layer switching architec- 

traffic according to given QOS criteria. The routing tables 24 lure is deployed and the lowest layer is responsible for 

are also used by signalling and call admission controls 26 to providing control connectivity 44. 
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The route server 40 in accordance with the invenlion 
further includes a central controller 46 and a plurality of 
packet processing elements referred to as intelligent line- 
cards 48. The intelligent line-cards AS are preferably inte- 
grated input/output (I-O) controllers having input ports 50 
and output ports 52. The ports terminate network links with 
specific physical addresses. Link state PDUs identify these 
links and their associated physical address uniquely. In order 
to achieve a greater degree of efficiency, it is common 
practice to multiplex traflBc from several ports (external 
links) at a lower speed to a higher speed internal port (via an 
internal link as opposed to a network link). This requires 
encapsulation of the network traffic using a protocol based 
on well-known address resolution protocols. Alternatively, 
the muhiplexing equipment has to appear as an independent 
network node with a collection of low-speed port/links and 
one high-speed port/link to the route server. This requires 
that the multiplexer node participate in network routing 
functionality independently of the route server. The intelli- 
gent line-cards 48 also are equipped with processors and 
memory to permit them to execute programs relating to 
sophisticated routing functions. The routing functions which 
are performed concurrently on the intelligent line-cards 25 
include: 

Header analysis and error checking: This includes decom- 
position of a packet to remove header information, 
identification of the protocol type in use, and header 
checksum processing. Header checksum processing 
includes the discard of erroneous packets and check- 
sum calculation, for example, as the lifetime field is 
updated. 

Routing, route recording and forwarding to subnets: Rout- 
ing includes the decision as to the type of underlying 
service which should be used to route the packet and 
includes checking of the QOS parameters. The for- 
warding function is then invoked which finds the 
destination port-id based on the information in the 
routing table. The route recording function adds the 
network address of the network route server 40 to the 
list of nodes on the route to the destination address. 

Lifetime control: The routing fiinction checks the packet's 
lifetime and discards the packet is this value is zero. It 
also decrements the lifetime field of the packet to 
prevent packets from looping indefinitely in a network. 

Segmentation: Some services require packets of a smaller 
packet size. Consequently, the routing function must 
detect when segmentation is required and provide pack- 
ets of a smaller packet size if necessary. 

Priority and QOS handling: Any given packet may request 
a specific priority and QOS treatment as it traverses the 
network. This capability is implementation-dependent 
but the route server 40 should be enabled to provide it 
if required. 

Congestion notification: This function enables intermedi- 
ate nodes to inform the destination of the onset of 
congestion within the node. Although this function is 
also implementation-dependent, the general idea is to 
prevent the accumulation of packets in output queues 
and to avoid the packet loss which may ensue. 
The intelligent line-cards 48 in accordance with the 
invention accommodate complete copies of the routing 
tables computed by the central controller 46. These complete 
copies of the routing tables are downloaded periodically by 
the central controller 46 to the intelligent line-cards 48 in 
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accordance with criteria which will be explained below in 
some detail. Providing complete copies of the routing tables 
and a comprehensive routing function on each intelligent 
line -card 48 provides the following advantages: 

It removes the central controller 46 as a choke point in the 
overall switch architecmre. Consequently, the switch 
capacity is limited only by the throughput of the switch 
fabric, which is the desired condition. 
It removes the latency in accessing routing information 
from a central location. In some switching 
implementations, a centralized approach involves store 
and forward of the packets through the central control 
which limits the capacity to half of the throughput of 
the switch fabric. 
Because the packets transit the switch fabric only once in 
the route server 40 and are subsequently routed by a 
forwarding engine at the line-cards, transit delays are 
likewise reduced. 
It provides a mechanism for refreshing the routing tables 
at regular intervals, hence protecting against any unpre- 
dictable corruptions. 
The only disadvantage of the scalable switching architec- 
ture for a route server 40 in accordance with the invention 
is the cost of hardware required to implement this distributed 
functionality. In view of the fact that hardware cost is 
steadily decreasing, the advantages far outweigh this disad- 
vantage. 

Performance Requirements of the Route Server 

The scalable switching architecture for a route server 40 
in accordance with the invention must be enabled to effi- 
ciently perform a number of key functions which include 
call setup, packet/cell forwarding, route discovery interval 
and routing stability. Distribution of the forwarding function 
also raises the question of routing and virtual circuit table 
update frequency and its reliable communication to the 
intelligent line-cards 48. 

Resource requirements of routing protocols are often 
described in terms of three categories of parameters: 

1) For an area of a given size, say "N", ability to update 
at least N link state packets within an interval of time 
of "T„" seconds. The interval T„ is selected to permit 
rapid conversions of area topology without putting 
undue stress on nodal resources. For dynamic traffic 
management, this interval also reflects a time constant 
of the traffic mix in the network. 

2) At maximum forward capacity of the node, the route 
server 40 must have the ability to: 

(a) forward incoming link state packets within a short 
interval of time, which is designated as "Ty seconds, 
and 

(b) route table calculations should be completed within 
a minimal accepted time period which is designated 
as "T/' seconds. 

3) In overload the routing control packets should have 
priority over payload data packets. 

In a distributed architecture these requirements translate 
to providing adequate CPU capacity at the RSE (central 
controller 46) to perform functions 1 and 2(b) described 
above. Items 2(a) and 3 require priority treatment of the 
routing protocol control packets over any other traffic 
including payload data. The question of routing table/VCI 
table update frequency and resource requirement also needs 
to be considered. Routing table update frequency from the 
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central controller 46 to the intelligent line-cards 48 is interval in the order of 100 ms., 30% over-provisioning of 

preferably determined as follows: the server control connectivity 44 is preferred. 

The minimum interval for updates should be equal to or Transit Delay 

greater than T^ seconds required for route table calcu- In order to assess the transit delay of packets in a central 
iations by the central controller 46. The maximum ^ versus a distributed architecture in accordance with the 
interval should preferably be set to less than or equal to invention, the following parameters are defined: 
T„ seconds which is the time required to update at least j 5,^^,, ^^^^ ^^^^-^^ ^ ^^^^^ 
one Imk state packet for each link m the network area ™ . . , , 
of the server 40. Those skilled in the art wiU appreciate ^ - ^^^^"^ ^'"^^ P^^^^*' 
that routes are also calculated as a consequence of any ^° ^'^cr Service time to access a central routmg table, 
change in the network topology and when significant Service time to transit the switch fabric. 
traflSc fluctuations are reported via link state packets. T^: The sum of T^^+T^+T^ used as a unit in the plots 
VC tables in the intelligent line-cards 48 are updated with shown in FIGS. 4a and 46. 
setup of new connections or take-down of existing Message flow charts illustrating the distribution of pro- 
connections as they occur. cessing in a prior art central control packet switch and a 
The size of the routing tables created by the central scalable switching architecture for a network route server 40 
controller 46 and downloaded to the intelligent line-cards 48 in accordance with the invention are shown in FIG. 4. Using 
can be on the order of 100 kbytes, or more. Updates to the a multi-stage open-queuing network model as taught by 
routing table therefore requires reliable acknowledged end- 20 Schwartz in "Telecommunication Networks'*, Addison Wes- 
to-end transmission of several large packets. These packets ley 1987, the load-delay performance of these two configu- 
may be multi-cast to all the intelligent line -cards 48. On the rations are compared in FIG. 5. 

other hand, VCl table updates are relatively small and have In a prior art central routing control packet switch, the 

individual destinations since each virtual circuit (VC) is throughput is limited by the transaction capacity of the 

handled by individual intelligent line -cards 48, At call setup, central routing control. The no load transit delays are also 

as a VC connection threads through the network, it is greater due to the requirement for an additional function for 

important to setup the VCI tables rapidly in order to mini- accessing the central routing tables. As shown in FIG. 4a, 

mize connection setup latency. VCI table updates should the transit delay for a packet switched by a route server 40 

therefore have priority over the routing table updates on an consists of: 
end-to-end basis. Control connectivity requirements may 

therefore be siunmarized as sufficient bandwidth over- T^cv+r^+i/- 

provisioning, multi-cast capability between the central con- As shown in HG. 4b, the transit delay in a prior art packet 

troller 46 and the intelligent line-cards 48, and reliable switch using central routing control consists of: 
end-to-end transmission and priority control for low latency 

T +T +T +T 

transmission of connection setup and tear-down parameters, acr r t 

Integration of control connectivity with the switch fabric It is assumed that the connectivity control is engineered to 

places similar performance requirements on the switch fab- have sufficient capacity for handling the traffic which results 

ric. from this access. The route server 40 in accordance with the 

Performance Impact of Route Server on Scalable Switch invention is, however, limited only by the capacity of the 

Architecture switch fabric and the aggregate forwarding capacity of the 

The network route server 40 is preferably configured to intelligent line-cards 48. The delay/load performance of a 

meet the above-identified perfonmance requirements using a single intelligent line-card 48 as compared to the central 
dual-level priority scheme throughout the system. This 45 control switch in accordance with the prior art as shown in 

includes the processing of routing control packets or control FIG. 5. As is apparent, very substantial improvements in 

cells at a higher priority than payload data packets, as well transit delay are realized in the route server 40 and the gains 

as communicating VCI table updates at a higher priority than in transit delay increase dramatically as the load offered to 

routing table copies. In order to assess the capacity require- the switch increases. It should also be appreciated by those 

ments of routing table updates and connection management skilled in the art that the aggregate performance of a server 

traffic, a dual-level head-of-line priority model is employed constructed with the intelligent fine-cards 48 in accordance 

as taught by Klienrock in "Queuing Systems Vol 2", Wiley with the invention scales by increasing the number of 

1975. The following parameters are used in the calculations: intelligent fine-cards 48 up to a point where the switch fabric 

RC: Connection setup rate. 55 capacity is realized. 

Xc: Service time of a connection. The design and performance of a route server 40 which 

Rt: Table update frequency. enables the scafing of distributed switching architecture has 

Xt: Service time requirement of a table update transaction. been described. The route server 40 in accordance with the 

C: Capacity of the server expressed as a unit of service invention permits the integration of switching and routing 

time. across a network and over a wider geographical area. The 

FIG. 3 shows the average delays in servicing of a table resulting architecmre is capable of significantly increasing 

update transaction, as well as the average delays of servicing switching capacity as well as an increased degree of network 

a VCI table update as a function of available server capacity, connectivity. The increase in network connectivity is due to 
Those skilled in the art will appreciate that a complete ^5 the dedication of the central controller 46 to the performance 

routing table copy wifi require hundreds of such iransac- of infonnation routing exchange functions while removing 

tions. Therefore, in order to keep the routing table update the load -dependent function of traffic forwarding to the 
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intelligent line-cards 48. As a consequence, the scalable 
switching architecture in accordance with the invention 
better scales with increasing network size. 

The preferred embodiment of the invention described 
above is intended to be exemplary only. Changes and 5 
modifications to the preferred embodiment may become 
apparent to those skilled in the art. The scope of the 
invention is therefore intended to be limited solely by the 
scope of the appended claims. 

I claim: lo 

1. A network route server with a scalable switching 
architecture, comprising: 

a route server element with which a node identity in the 
network is associated, the route server element includ- 
ing processor means for creating a routing table for the 
route server using a topology database and a routing 
algorithm, the route server element periodically copy- 
ing the routing table to each of a scalable array of 
packet processing elements associated with the route 
server element; 20 

each packet processing element having a hnk-port^ inter- 
face to the network, memory means for storing a copy 
of the routing table, and processor means for using the 
copy of the routing table to route packets received by 
the packet processing element, each packet processing 25 
element being enabled to autonomously route packets 
received by the packet processing element by referenc- 
ing the copy of the routing table; and 

a switch fabric for the switching of packets between the 
packet processing elements in accordance with routing 3Q 
information provided by the packet processing 
elements, the scalable array of packet processing ele- 
ments having an aggregate capacity that is scalable to 
a capacity of the switch fabric. 

2. A network route server with a scalable switching 
architecture as claimed in claim 1 wherein the route server 
further includes a backplane bus or similar means of distri- 
bution over a wide area for providing control connectivity 
between the route server element and the packet processing 
elements. 

3. A network route server with a scalable switching 
architecture as claimed in claim 1 wherein switching con- 
nectivity is provided for data packets through a cell or packet 
switch fabric. 

4. A network route server with a scalable switching 45 
architecture as claimed in claim 1 wherein the route server 
element farther controls connection oriented services and 
provides connection oriented call admission, and data 
related to virtual circuits associated with connection oriented 
services are downloaded to the packet processing elements 50 
from the route server element each time a coimection 
oriented service request is set up or torn down. 

5. A network route server with a scalable switching 
architecture as claimed in claim 4 wherein data updates to 
the packet processing elements for data related to virtual 
circuits associated with connection oriented services are 
dovraloaded with priority over all other server traffic. 

6. A network route server with a scalable switching 
architecture as claimed in claim 5 wherein the copying of the 
routing table is accomplished with a lesser priority than the 
data updates to the packet processing elements for data 
related to virtual circuits. 

7. A network route server as claimed in claim 1 wherein 
the route server element periodically copies the routing table 55 
to each of the packet processing elements in a multi-cast 
mode. 



55 



8. A network route server with a scalable switching 
architecture as claimed in claim 1 wherein each packet 
processing element performs functions which include; 
header translation and checksum processing; packet lifetime 
processing; packet routing; and, advising adjacent nodes of 
a congested condition if packets have accumulated in the 
input or output butters of the packet processing element. 

9. A network route server with a scalable switching 
architecture, comprising: 

a route server element with which a node identity in the 
network is associated, the route server element includ- 
ing processor means for executing a topology discovery 
protocol and maintaining a topology database of the 
network, and for creating a routing table for the route 
server using the topology database and a routing 
algorithm, the route server element periodically copy- 
ing the routing table to each of a scalable array of 
packet processing elements associated with the route 
server element; 

each packet processing element having a link-port inter- 
face to the network, memory means for storing a copy 
of the routing table, and processor means for using the 
copy of the routing table to route packets received by 
the packet processing element, each packet processing 
element being enabled to autonomously route packets 
received by the packet processing element by referenc- 
ing the copy of the routing table; and 

a switch fabric for the switching of packets between the 
packet processing elements in accordance with routing 
information provided by the packet processing 
elements, the scalable array of packet processing ele- 
ments having an aggregate capacity that is scalable to 
a capacity of the switch fabric, 

10. A network route server with a scalable switching 
architecture as claimed in claim 9 wherein the control 
connectivity comprises a backplane bus, or is overlaid on the 
switch fabric for distributed implementations. 

11. A network route server with a scalable switching 
architecture as claimed in claim 10 wherein the route server 
is geographically distributed and the control connectivity is 
provided by data packets communicated through the switch 
fabric. 

12. A network route server with a scalable switching 
architecture as claimed in claim 10 wherein the control 
connectivity is provisioned 30% over anticipated peak load 
traffic to keep the routing table update interval low. 

13. A route server with scalable switching architecture as 
claimed in claim 10 wherein a frequency at which the route 
server element periodically copies the routing table to each 
of the packet processing elements is greater than the time 
required by the route server element to calculate a new 
routing table and less than or equal to a maximum interval 
represented by the average time required to process N link 
state packets where N represents the number of links in a 
network area occupied by the route server, 

14. A route server with scalable switching architecture as 
claimed in claim 13 wherein the routing table is copied to 
each of the packet processing elements whenever network 
topology changes or significant fluctuations in traffic that 
affect routing occur, regardless of whether the maximum 
interval has expired since a last copy process. 

15. A route server with a scalable switching architecture 
as claimed in claim 10 wherein packets are switched in a 
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dual level priority scheme wherein routing control packets 
or control cells are switched with a higher priority than 
payload trafiBc, and VCI table updates are commuoicated at 
a higher priority than routing table updates. 

16. A network route server with a scalable switching ^ 
architecture, comprising: 

a route server element with which a node identity in the 
network is associated, the route server element includ- 
ing processor means for executing a topology discovery 
protocol and maintaining a topology database of the 
network, and for creating a routing table for the route 
server using the topology database and a routing 
algorithm, the route server element periodically copy- 
ing the routing table to each of an array of packet 15 
processing elements associated with the route server 
element, and a call admission control module which is 
responsible for the admission of connection oriented 
services through the server, the call admission control 
module receiving virtual circuit connection requests 20 
and downloading to a packet processing element, 
which is to establish the virtual circuit, data related to 
the virtual circuit; 

each packet processing element having a link-port inter- 
face to the network, memory means for storing a copy 25 
of the routing table, and processor means for using the 
copy of the routing table to route packets received by 
the processing element, each packet processing element 
is enabled to autonomously route packets received by 
the packet processing element by referencing the copy 30 
of the routing table, and to route connection oriented 
packets in accordance with the data downloaded from 
the route server element when a virtual circuit is set up; 

control connectivity for exchanging control data between 
the route server element and the packet processing ^5 
element; and 

a switch fabric for the switching of packets between the 
packet processing elements in accordance with routing 
information provided by the packet processing 



elements, the packet processing elements having an 
aggregate capacity that is scalable to a capacity of the 
switch fabric. 

17. A method of routing packets or cells in a network 
using a route server having a route server element, a 
plurality of packet processing elements with link-port 
interfaces, a processor and a memory to permit the packet 
processing elements to perform routing functions to the 
network and a switch fabric, comprising: 

a) periodically creating at the route server element a 
routing table using a topology database and a routing 
algorithm; 

b) periodically copying the routing table to a memory in 
each of the packet processing elements; 

c) using the copy of the routing table at each packet 
processing element to route packets received at the 
link-port interface of the packet processing element; 
and 

d) switching packets between the packet processing ele- 
ments in accordance with routing information provided 
by the packet processing elements using the copy of the 
routing table and the routing functions. 

18. The method of routing packets or cells in a network as 
claimed in claim 17 further including the steps of: 

a) controlling at the route server element connection- 
oriented services and connection-oriented call admis- 
sion and downloading to the route server elements data 
related to virtual circuits associated with connection- 
oriented services each time a connection-oriented ser- 
vice request is set up or torn down. 

19. llie method of routing packets or cells in a network as 
claimed in claim 17, further including the steps of; 

a) executing at the route server element a topology 
discovery protocol and maintaining the topology data- 
base in response to outputs from the topology discovery 
protocol. 
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